err on the side of something

​to show too much of a good quality in order to avoid showing too little

I thought it was better to err on the side of caution (= to be too careful rather than take a risk).